DISPLAY 



121 



V 



KEYPAD 
INPUT 



122 



CURSOR 

CONTROL 
123 



HARDCOPY 

DEVICE 
124 



V 



INPUT/ 
OUTPUT 
DEVICES 
125 



A 
V 



CAMERA 

DEVICES 
128 




MAIN 

MEMORY 

104 




STATIC 

MEMORY 
106 




FLASH 

MEMORY 

107 








\ 


BUS 


101 






0 



DISPLAY 
CIRCUIT 



105 



CPU 


CO-PROCESSOR 
103 


CONTROL UNITJ31 


ALU 132 


1 


REGISTERS J33 

• • 

• • 

• • 


m 



110 



FIG. 1 



200 

/ 



LEARNING STAGE 210 









SHAPE 

TRAJECTORY 
+ 




— ► 


CALCULATING 

>;(!) 

PRINCIPAL 
SHAPE VECTORS 


INPUT 
STEREO 
SEQUENCE 




STEREO 
TRACKING 


PCA 
PROCESSING 


— ► 






s 

202 


204 


206 





208 



COMPUTED MODEL 



MONOCULAR TRACKING 22Q 
USING 
COMPUTED-MODEL 
(APPROXIMATING ANY GENERIC SHAPE 
AS A LINEAR COMBINATION 
OF PRINCIPAL SHAPE VECTORS) 



OUTPUT 



MONOCULAR 
INPUT 
SEQUENCE 



FIG. 2 



FRAME 1 FRAME 40 FRAME 100 



LEFT 
CAMERA 
IMAGE 



RIGHT 
CAMERA 
IMAGE 





— . — 















FIG. 3 




FIG. 4 



CNJ 
LU 



< 



LO 

LU 





INITIALIZING A SET OF POINTS ON A LEFT 
CAMERA IMAGE AND A RIGHT CAMERA IMAGE 
602 



TRACKING THE SET OF POINTS 
604 



FIG. 6 



208 



COMPUTING MEAN SHAPE 
x' 

x o 



702 



SUBTRACTING MEAN SHAPE FROM WHOLE 
TRAJECTORY TO OBTAIN SHAPE 
TRAJECTORY M 



704 



APPLYING SINGULAR VALUE DECOMPOSITION 
(SVD) ON SHAPE TRAJECTORY 
M 



706 



TRUNCATING THE DECOMPOSITION OF 708 



M TO P TERMS TO OBTAIN 
PRINCIPAL SHAPE VECTORS 



FIG. 7 



220 



ESTIMATING PARAMETERS FOR SHAPE AND 
POSE USING IMAGE MEASUREMENTS 
802 



FINDING OPTIMAL SHAPE AND POSE USING 
FACE MODEL THAT BEST FITS THE 
SUBSEQUENT FRAME 
804 



FIG. 8 



